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ABSTRACT 
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This  report  is  a draft  of  Chapter  8 of  a forthcoming 
book  on  "Picture  Languages."  [Drafts  of  Chapter  2,  on 
digital  topology,  and  Chapters  3-5,  on  sequential  and 
parallel  picture  acceptors,  were  issued  earlier  as  TR's 
542  and  613,  respectively.]  This  chapter  deals  with  array 
grammars,  with  emphasis  on  their  relationship  to  acceptors; 
some  preliminary  material  on  string  grammars  is  also  included. 
Comments  on  the  choice  and  treatment  of  the  material  are 
invited. 
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Chapter  8 
ARRAY  GRAMMARS 


In  the  previous  chapters  we  have  discussed  various  types 
of  string  and  array  acceptors . This  chapter  introduces 
grammars  that  can  be  used  to  either  generate  or  accept 
("parse")  sets  of  strings  or  arrays.  It  defines  a hierarchy 
of  such  grammars,  and  establishes  equivalences  between  certain 
classes  of  grammars  and  of  acceptors. 


1.  String  grcimmars 


We  first  consider  grammars  that  generate  or  parse  sets 


of  strings.  Sections  1.1-2  review  the  usual  definitions 
of  such  grammars.  Section  1.3  defines  "isometric"  grammars 
that  rewrite  #s,  rather  than  simply  extending  the  given 
string;  this  alternative  approach  will  be  important  when  we 
treat  array  grammars  in  Section  3.  Section  1.4  discusses 
various  definitions  of  "parallel"  grammars  and  their  relation- 
ships to  conventional  (sequential)  grammars. 


1 . 1 Grammars 


Informally,  a (string)  grammar  G is  a mechanism  that 
generates  a set  of  strings  by  a process  of  repeatedly  substi- 
tuting one  substring  for  another,  starting  with  a standard 
initial  string.  The  (rewriting)  rules  or  productions  of  G 
specify  which  substrings  can  be  replaced  by  which  others. 

The  language  of  G is  the  set  of  strings  (usually  required  to 
consist  entirely  of  symbols  of  a special  type,  called  "ter- 
minal" symbols)  that  can  be  produced  in  this  way.  We  shall 
now  define  these  ideas  more  precisely. 

As  we  did  in  Chapter  3 for  automata,  we  shall  require 
that  grammars  satisfy  certain  finiteness  and  nontriviality 
conditions.  Specifically,  we  shall  assume  that  the 
vocabulary , or  set  of  symbols,  the  subset  of  "terminal" 
symbols,  and  the  set  of  rules  are  all  finite,  nonempty  sets. 

We  shall  also  assume  that  the  initial  string  consists  of  a 
single  non-terminal  symbol  S.  Under  these  assumptions,  we 
can  formally  define  a ("type  0")  grammar  G to  be  a 4-tuple 
(V,V,j,,P,S)  , where 

V is  the  vocabulary  (a  finite,  nonempty  set  of  symbols) 

V,j,  & V is  the  terminal  vocabulary  (?^  0) 

StV-V^  is  the  initial  symbol 

P is  a finite,  nonempty  set  of  pairs  (a, 3),  where  a and 
3 are  non-null*  strings  of  elements  of  V.  These  pairs 

*We  require  3 to  be  non-null  to  prevent  the  null  string  from 
being  generated  by  a grammar;  this  corresponds  to  our  require 
ment,  in  earlier  chapters,  that  the  input  strings  of  acceptor 
are  always  non-null. 
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are  called  the  rules  of  G,  and  are  usually  written  in 
the  form  a^3  (denoting  the  fact  that  a can  be  replaced 
by  3)  . 

In  order  to  define  the  language  of  G,  we  must  introduce 
the  notion  of  a "derivation"  in  G.  We  say  that  the  string 
T is  directly  derived  from  the  string  a in  G (notation: 
o ^ t)  if  there  exists  a rule  a^3  of  G such  that  a is  a 
substring  of  a,  and  t is  the  result  of  replacing  some 
occurrence  of  a (as  a substring  of  o)  by  3.  We  say  that  t 
is  derived  from  a in  G (notation:  o if  there  exists 

-Vj 

a sequence  of  strings  o = = t,  where  n ^ 0, 

such  that  is  directly  derived  from  in  G,  1 ^ i ^ n. 

The  set  of  strings  on  that  can  be  derived  in  G from  the 
initial  string  S (consisting  of  the  single  symbol  S)  is 
called  the  language  of  G,  and  is  denoted  by  L(G).  A 
sequence  of  strings  S=OQ,a^,  . . . ,o^=TfcL(G)  for  which 
a.  T So.  is  called  a derivation  of  t in  G.  (We  will  omit 
"in  G"  from  now  on  unless  there  is  danger  of  confusion.) 

Given  any  grammar  G,  there  exists  a grammar  G'  in 
which  terminal  symbols  are  never  rewritten  by  any  rule, 
and  such  that  L(G')  = L(G).  In  fact,  we  can  define  G'  to 
have  nonterminal  vocabulary  (V-V^)UV^,  , where  V,|,  is  a set 
of  primed  copies  of  the  symbols  in  V^.  For  each  rule  a->3 
of  G,  we  have  the  rule  a'->-3'  in  G' , where  the  primes  denote 
the  fact  that  each  symbol  in  is  replaced  by  the  corres- 


ponding symbol  in  V' 


In  addition,  G'  has  the  rules  x'-*-x 


for  all  xfcV^,.  Evidently  a string  on  V,j,  is  derivable  in  G'  if 
it  is  derivable  in  G (since  G'  can  derive  the  corresponding 
string  on  V^,  which  can  then  be  changed  into  a string 
using  the  x'->x  rules),  and  conversely  (since  the  x'-*-x  rules 
are  the  only  rules  of  G'  that  produce  symbols  in  V,^)  . [Note 
that  if  the  x'->-x  rules  are  applied  too  soon,  it  may  be  im- 
possible to  complete  a derivation,  since  a rule  a '->-6'  may  re- 
quire the  presence  of  some  primed  symbol  that  has  already 
become  unprimed. ] We  shall  assume  from  now  on  that  grammars 
never  rewrite  terminal  symbols. 

A grammar  can  function  as  an  "acceptor"  by  performing 
derivations  in  reverse.  Given  a string  a on  V^,  we  say  that 
G parses  a if  there  exists  a sequence  of  strings 
0=0,0  ,,...,0-=S  such  that  o.  , is  the  result  of  apply- 

ing  a rule  a-^3  of  G in  reverse  (i.e.,  replacing  3 by  a)  to 
o^,  1 i i s.  n.  It  is  clear  that  this  is  the  same  thing  as 
saying  that  Oq,...,o^  is  a derivation;  thus  o is  parsed  by  G 
iff.  it  is  generated  by  G. 

A less  trivial  equivalence  between  grammars  and  acceptors 
is  provided  by 

Theorem  1.1.  The  languages  generated  by  grammars  are  the 
same  as  the  languages  accepted  by  Turing  acceptors. 

Proof:  Let  L be  generated  by  G;  then  we  can  define  a Turing 

acceptor  A that  operates  as  follows:  Given  a string  o,  A 
creates  an  S (separated  from  o by  a distinctive  marker)  and 
then  (nondeterministically)  applies  a sequence  of  rules  of 


T 


G,  starting  with  the  S (and  leaving  a intact) , to  produce  a 
sequence  of  strings  Oq  = At  each  step  of  this 

process,  it  compares  with  o (this  can  be  done  by  moving 

back  and  forth  from  to  o,  and  marking  off  corresponding 
symbols  if  they  are  the  same) . If  at  any  stage  A finds  that 
= a,  it  accepts.  Evidently  this  happens  iff.  afcL(G) . 

Conversely,  let  L be  accepted  by  A.  We  shall  define 
below  a grammar  that  generates  two  copies  of  an  arbitrary 
string,  and  simulates  the  operation  of  A on  one  copy.  If 
the  simulation  accepts,  Gj.  erases  that  copy  and  converts  the 
other  copy  to  a terminal  string.  Evidently  a terminal 
string  a is  produced  by  G^  in  this  way  iff.  otL(A). 

The  grammar  G^  has  the  following  sets  of  rules : 


(1) 


s 

S' 

S' 

s 


S' (x' ,x) 

S' (x,x) 

((qQ,N),  (x",x)) 
((qg,N),  (x*,x)). 


for  all  X in  the 
vocabulary  of  A 


These  rules  generate  a string  of  the  form  ( (q^ ,N) (x* ,x) ) , 
or  ( (qQ,N)  (x^,Xj^) ) (X2,X2)  , . . . , (x^_j^,Xj^_j^)  , (x'^,x^)  (where 
n > 1) . Primed  x's  are  always  at  the  right  end  of  the 
string;  double-primed  x's,  at  the  left  end;  and  starred  x's 
are  always  singletons.  Here  q^  represents  the  initial  state 
of  A at  the  left  end  of  its  input  string. 

(2)  For  all  u,v,w,x,y,z, 

(a)  ( (qj^,d)  (w,x)  ) -►  ( (q2  »N)  (t,x) ) for  all 

(q2 *t ,N) t6 (q^ ,w,d) , where  6 is  the  transition 


function  of  A,  and  where  if  w is  primed, 
double-primed,  or  starred,  so  is  t.  These 
rules  simulate  the  case  where  A changes  state 
and  rewrites  a symbol  but  does  not  move. 

(b)  (u,v)  ( ,d)  (w,x)  ) ( (q2,L)  (u,v)  ) (t,x)  for 

all  (q2 ,t,L) t6 (q^ ,w,d) , where  if  w is  primed, 

so  is  t.  These  rules  handle  the  case  where 

A moves  left,  provided  it  was  not  at  the 

left  end  of  the  string. 

(b')  ((q^,d)  (w",x))  ^ ( (q  ,L)  (#",#))  {t,x)  'i 

r for 

({q3^,d)  (w*,x))  -V  ((q2,L)  (#",#))  (t',x)J 
all  (q2, t,L) t6 (q^,w,d) 

Rules  (b')  handle  the  case  where  A is  at  the 
left  end  of  the  non-#s  and  moves  left. 

(c)  ( (q^,d)  (w,x)  ) (y,z)  ->■  ( t ,x)  ( (q2  , R)  (y , z ) ) for 

all  (q2  , t ,R)  (q^^  ,w ,d),  where  if  w is  double- 

primed,  so  is  t.  These  rules  handle  the 

case  where  A moves  right  and  was  not  at  the 

right  end  of  the  string. 

(c-)  ((q^,d)  (w* ,x))  ^ (t,x)  ( (q2,R)  (#',#) ) 1 

> for 

( {q^,d)  (w*,x) ) ^ {t",x)  { (q2,R)  (#',#) )J 
all  (q2  ,t,R)  t6  (qj^,w,d). 

Rules  (c')  handle  the  case  where  A is  at  the 
right  end  of  the  non-#s  and  moves  right. 


These  rules  simulate  A on  the  string,  adding  pairs  of  #s  at 
its  ends  if  necessary.  Note  that  the  conventions  about  primes, 


double-primes  and  stars  are  preserved  by  these  rules.  Note 
also  that  the  simulation  affects  only  the  first  terms  of 
the  pairs;  the  second  terms  are  unchanged,  except  that  # 
second  terms  may  be  added  at  the  ends.  We  assume  in  (2) 
that  q is  not  an  accepting  state  of  A. 

(3)  For  all  w,x,y,z,  where  w may  be  double-primed 
and  y may  be  primed,  and  for  all  accepting  states 

of  A, 

( (q^,d)  (w,x)  ) (y  ,x)  {w,x)  ( (q^,d)  (y  ,z)  ) 

When  an  accepting  state  is  created,  it  moves 
rightward. 

(4)  For  all  w,x,y,z,  where  w may  be  double-primed, 

( (q^,d)  (y' ,z) ) ^ ((y'fZ)q^)  if  z # 
(w,x)  ( (q^,d)  (y' ,#)  ) {(w,x),q^) 

( (q^,d)  (y*,z) ) -»■  z 

When  (q^,d)  reaches  the  right  end  of  the  string, 
it  becomes  q^  if  the  second  term  at  the  right 
end  is  non-#,  or  erases  the  # and  becomes  q^ 
if  the  second  term  at  the  right  end  is  # . If 
the  string  is  a singleton,  (q^,X)  turns  it  into 
a singleton  terminal  (the  second  term  must  be 
non-#  in  this  case,  since  the  original  string 
of  second  terms  was  non-null) . 

(5)  For  all  w,x,y,  where  w may  be  double-primed  in 
the  second  case. 
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The  moves  leftward,  erasing  #s;  when  it 

reaches  a non-#  second  term  (which  must  happen 
eventually,  since  the  original  string  was  non- 
null) , it  becomes  q^. 

(6)  For  all  w,x,y,z,  where  y may  be  primed, 

(w,x)  ( (y,  z)  ,q^)  ->■  ((w,x),q^)z  if  x # 

( (y"  f z)q^)  z 

The  q moves  left,  turning  pairs  with  non-#  second 
terms  into  their  second  terms;  if  it  reaches  the 
left  end  of  the  string,  it  erases  itself,  leaving 
only  its  pair's  second  term  z.  Note  that  z 
cannot  be  #,  by  (4-6). 

(7)  For  all  w,y,z,  where  y may  be  primed, 

(w,#)  ( (y,z)  ,q^)  ->  ((y,z),q^) 

(w" ,#) ( (y ,z) ,q^)  ^ z 

If  the  q^  reaches  # second  terms  (which  must  lie 
to  the  left  of  all  the  non-#  second  terms) , it 
erases  them;  when  it  erases  the  last  one,  it  also 
erases  itself,  leaving  only  its  pair's  second  term 

Evidently,  this  process  generates  a terminal  string  (namely, 
the  original  string  of  second  terms;  the  terminal  vocabulary 
of  is  the  same  as  the  vocabulary  of  A)  iff.  the  simulation 


1.2.  Special  types  of  qraimnars 


A grammar  G is  called  context-sensitive  (or  "type  1") 
if  for  each  rule  a-»-3  of  G there  exist  strings  H/  and  t on 
V,  where  x is  non-null,  and  a symbol  AfcV-V^,  such  that 
a = 5An  and  3 = ^xn.  Thus  any  such  rule  rewrites  a single 
nonterminal  A,  "in  the  context  of"  C and  n,  as  a non-null 
string  x.  Note  that  in  such  a grammar,  terminals  are  never 
rewritten. 

We  shall  call  a grammar  G monotonic  if  for  each  rule 
a-»-3  of  G we  have  | a | ^ 1 3 1 . 

Theorem  1.2.  The  languages  generated  by  monotonic  grammars 
are  the  same  as  those  generated  by  context-sensitive  grammars. 


Proof ; Context-sensitive  certainly  implies  monotonic,  since 
X non-null  implies  1 ?An 1 ^ |Cxn|.  To  prove  the  converse,  we 
show  that  any  rule  a->3  with  la|  ^ l3|  can  be  replaced  by  a 
set  of  context-sensitive  rules  without  altering  the  language 
generated  by  the  grammar.  We  can  assume,  as  shown  earlier, 
that  the  given  grammar  does  not  rewrite  terminals,  so  that 
the  symbols  involved  in  the  rule  a->-3  are  all  nonterminals 
(unless  the  rule  is  of  the  form  x'  ->■  x,  which  is  already 
context-sensitive) . 

Let  a = A, . . .A„  and  3 = B, ...B  , where  m ^ n.  Then 
1 m In 

we  can  replace  a^3  by  the  following  sets  of  context-sensitive 
rules : 


^11^2  ^11^22 
^m-l,m-l^m  ^ ^m-l,m-l^mm 


(1) 


r 


These  rules  successivelj'  change  the  symbols  in  a to  special 
forms  which  are  understood  to  be  unique  to  the  given  rule 
and  to  the  given  position  in  that  rule,  so  that  they  can  only 
be  applied  in  the  given  sequence.  If  a rule  is  applied  in 
the  wrong  place  (only  the  beginning  of  a is  present,  or  a 
later  part  of  a is  the  same  as  its  beginning) , the  rule 
sequence  (1)  cannot  go  to  completion,  and  there  is  no  way  to 
get  rid  of  the  last-created  special  symbol  (unless  the  rest 
of  a is  later  created;  but  if  this  happens,  it  cannot  depend 
on  the  presence  of  the  special  symbols,  and  so  could  have 
happened  earlier) . 


^11^22  ®1^2 
^22^33  ®2^33 


B B . .B 
m m+1  n 


These  rules  change  the  special  A's  to  B's  after  the  next 
ones  have  been  created  (except  in  the  case  of  the  last  one) . 
As  already  pointed  out,  this  process  can  go  to  completion 
only  if  all  the  special  A's  are  created,  which  can  only 
happen  if  all  of  a is  present  (or  could  have  been  present) . 
Thus  replacing  a-^3  by  (1-2)  cannot  change  L(G)  , since  the 
only  way  (1-2)  can  create  a string  free  of  special  symbols 
is  to  simulate  a complete  application  of  a-^3,  and  analogously 
for  all  the  other  rules  of  G.// 


Theorem  1.3.  The  languages  generated  by  monotonic  grammars 


are  the  same  as  those  accepted  by  tape-bounded  acceptors. 

Proof:  When  a terminal  string  o is  derived  from  S in  a 
monotonic  grammar,  the  successive  strings  in  the  derivation 
have  nondecreasing  lengths,  so  that  none  of  them  is  longer 
than  o.  Hence  in  the  first  part  of  the  proof  of  Theorem  1.1, 
A can  generate  an  S by  turning  some  symbol  x of  a into  a 
pair  (S,x) , and  then  simulating  the  application  of  a 
sequence  of  rules,  creating  further  pairs  as  necessary,  and 
shifting  the  pairs  leftward  or  rightward  if  it  comes  to  the 
end  of  0.  If  the  string  of  first  terms  generated  in  this 
way  tries  to  become  longer  than  a,  A cannot  possibly  be 
simulating  a derivation  of  a.  Thus  in  carrying  out  the 
proof  of  the  first  part  of  Theorem  1.1  in  the  case  where  G 
is  context-sensitive,  A need  never  move  off  the  non-#s. 

Conversely,  in  the  second  part  of  the  proof,  note  that 
the  rules  of  are  all  monotonic  except  for  some  rules  in 
(4-7)  which  erase  #s;  but  these  rules  are  not  needed  if  A is 
tape-bounded,  since  rules  (2b')  and  (2c')  are  never  used,  so 
that  pairs  with  # second  terms  are  never  created.  (Since 
the  string  ends  are  marked  " and  * , tne  simuianon  of  a need 
not  involve  #s  at  all,  even  when  A bounces  off  them.)  Thus 
if  A is  tape-bounded,  G^  is  monotonic.// 

A grammar  G is  called  context-free  (or  "type  2")  if 
in  all  rules  of  G,  a is  a single  nonterminal  symbol  and 
g is  non-null.  (Evidently  context-free  implies  context- 


r 


sensitive.)  G is  called  finite-state  (or  "type  3")  if  in 
all  rules  a-*-3  of  G,  a is  a single  nonterminal  symbol  and  3 
either  ends  in  a single  nonterminal  symbol,  possibly  preceded 
by  terminal  symbols,  or  else  3 is  a nonnull  string  of 
terminal  symbols. 

Theorem  1.4.  The  languages  generated  by  finite-state  grammars 
are  the  same  as  the  languages  accepted  by  finite-state  accept- 
ors. 

Proof:  If  given  G,  we  define  an  FSA,A,  that  operates  on  its 

input  string  a as  follows:  A examines  the  right  end  of  o 
for  matches  to  right-hand  rules  of  G.  If  o = aj^32^,  where 
-*■  3j^  is  a rule  of  G,  A memorizes  Bj^,  moves  to  just  past 
the  beginning  of  3^^  (i.e.,  to  the  right  end  of  , and  looks 
for  matches  of  the  right  end  of  Oj^B^  to  right-hand  sides  of 
rules  of  G.  If  it  finds  such  a match,  say  to  B2  ^2®!' 

where  process  is  repeated,  with  o becoming 

shorter  at  each  repetition.  If  at  some  stage  A finds  that 
all  of  o 3 matches  the  right-hand  side  of  a rule  of  G whose 
left-hand  side  is  S,  then  A accepts  0.  Evidently  this  can 
happen  iff.  o can  be  derived  in  G,  using  the  succession  of 

rules  V®2®1'  V®!' 

A accepts  o iff.  atL(G). 

Conversely,  suppose  that  L is  accepted  by  a one-way 
FSA,  A.  We  can  define  a finite-state  grammar  G that  generates 
L as  follows: 

1)  S -►  (qQ,x)  for  all  x 


2)  (q,x)  -►  x(q',y)  for  all  q'fc6(q,x)  and  all  y,  where  6 

is  A's  transition  function,  and  q is  a non-accept- 
ing state  of  A. 

3)  -►  X for  all  accepting  states  q^  of  A. 

Here  the  x's  (the  vocabulary  of  A)  constitute  the  terminal 
vocabulary  of  G.  Thus  G generates  a string  and  simulates  A's 
behavior  on  it;  it  generates  an  all-terminal  string  o iff.  A 
accepts  a.// 

Theorems  1.1-4  tell  us  that  the  languages  of  (arbitrary, 
context-sensitive,  finite-state)  grammars  are  the  same  as 
the  languages  of  (Turing,  tape-bounded,  finite-state) 
acceptors,  respectively.  [It  can  be  shown  (e.g.,  [1,  pp.  74- 
78] ) that  the  languages  of  context-free  grammars  are  the 
same  as  the  languages  of  one-way,  nonde termini s tic  pushdown 
acceptors,  but  we  will  not  prove  this  here.]  Thus  introduc- 
ing these  types  of  grammars  has  not  expanded  our  language 
hierarchy. 


1. 3 Isometric  grammars 


In  this  section  we  consider  grammars  in  which  the 
left  and  right  hand  sides  of  any  rule  have  the  same 
length  — i.e.,  |a|  = |8|.  In  such  "isometric"  grammars 
(called  "isotonic"  in  [2]),  strings  grow  by  rewriting  #s, 
and  the  initial  string  is  #"S#".  We  shall  show  that  such 
grammars  generate  the  same  set  of  languages  as  do  ordinary 
grammars,  and  that  by  suitably  restricting  them,  we  obtain 
the  context-sensitive  and  finite-state  languages.  The  re- 
striction that,  in  any  rule  a-»-g,  a and  3 must  be  of  the  same 
size  will  prove  to  be  important  when  we  define  array  grammars 
in  Section  3. 

Formally,  an  isometric  grammar  is  a 5-tuple 
G = (V,V^,P,S,#)  , where  V,V,j,,P  and  S are  defined  just  as  in 
Section  1.1,  except  that  for  all  pairs  (a,3)tP  we  require  that 

a)  |al  = l3l 

b)  a does  not  consist  entirely  of  #s 

c)  Replacing  a by  3 cannot  disconnect  or  eliminate 
the  non-#s*. 

The  symbol  #tV-V^  is  called  the  blank  symbol.  Derivations 
are  defined  exactly  as  in  Section  1.1.  The  language  of  G is 
the  set  of  all  (non-null)  strings  a on  such  that  # a#  can 

oo  oo 

be  derived  in  G from  the  initial  infinite  string  # S#  . 


*Readily,  condition  (c)  is  equivalent  to  the  following:  The 
non-#s  in  3 exist  and  are  connected;  if  a has  a non-#  at  its 
left (right)  end,  so  does  3. 


Theorem  1.5.  The  languages  generated  by  isometric  grammars 


are  the  same  as  those  generated  by  ordinary  grammars. 

Proof : For  any  grammar  G,  we  can  define  an  isometric  grammar 

G'  that  generates  exactly  L(G)  as  follows: 

1)  For  every  rule  a->-g  of  G such  that  ja]  s.  |3|,  G' 

I a I - I 6 1 

has  the  rule  a ^ I -*■  8,  where  ^ is  a special 

nonterminal  symbol. 

2)  For  every  rule  a->-8  of  G such  that  [aj  ^ l8|»  G'  has 

the  rule  a-^8  . 

3)  In  addition,  G'  has  the  rulesx#  ->  xl|  , x^  -►  t|x, 

and  X ->■  ##x,  for  all  non-#x.  These  rules  allow 
#s  to  be  changed  into  t^s  at  the  right  end  of  the 
string  of  non-#s;  to  be  shifted  leftward;  and 

s to  be  changed  back  to  #s  at  the  left  end  of  the 
string. 

It  is  easy  to  see  that  G'  can  generate  a terminal  string  o 
(surrounded  by  #s)  iff.  just  enough  ^s  are  created,  and  they 
are  shifted  into  just  the  right  positions,  to  allow  a de- 
rivation of  a in  G to  be  simulated  using  rules  in  (1-2) 

(The  terminal  vocabulary  of  G'  is  the  same  as  that  of  G.) 

Thus  L(G' ) = L(G) . 

Conversely,  given  an  isometric  grammar  G',  we  can  de- 
fine G such  that,  for  every  rule  a-^8  of  G'  , G has  the  rule 
a'  ■*  8'f  where  a'  and  8'  are  the  same  as  a and  8 but  with  #s. 


if  any,  omitted.  It  is  not  hard  to  see  that  G can  generate  a 
terminal  string  o iff.  G'  generates  #”o#“’.  (We  recall  that 
under  G'  the  non-#s  remain  connected;  thus  derivations  in  G 
differ  from  those  in  G'  only  in  that,  when  G'  destroys  or 
creates  #s  at  its  ends,  G simply  grows  or  shrinks.)// 

Theorem  1.6.  The  languages  generated  by  isometric  grammars 
that  never  create  #s  (i.e.,  for  all  rules  a-»-3,  there  can  be 
#s  in  3 only  in  positions  corresponding  to  #s  in  a)  are  the 
scime  as  those  generated  by  monotonic  grammars. 

Proof;  In  the  first  part  of  the  proof  of  Theorem  1.5,  if  G 
is  monotonic  there  are  no  rules  of  type  (2) ; hence  we  can 
omit  the  rules  #^x  ->  ##x  and  still  guarantee  that  deriva- 
tions in  G can  be  simulated,  by  creating  and  shifting  in 
just  enough  to  allow  the  rules  of  type  (1)  to  operate. 

Thus  if  G is  monotonic,  we  can  define  G*  so  that  it  never 
creates  #s.  In  the  second  part  of  the  proof,  if  G'  never 
creates  #s,  then  for  all  rules  a-»-3  of  G'  we  have 
I a' I i I 3' If  that  G is  monotonic.// 

Theorem  1.7.  The  languages  generated  by  isometric  graunmars 
whose  rules  are  all  of  the  form  3#™  3,  where  [31  = m+1  and 

3 is  a string  of  terminals  ending  in  at  most  one  (non-#)  non- 
terminal, are  the  same  as  the  languages  generated  by  finite- 
state  grammars.// 


1 . 4 Parallel  granmtars 


As  defined  in  Sections  1.1-2,  a grammar  generates  (or 
parses)  a string  by  applying  only  one  rule  a-^6  at  a time, 
and  replacing  only  one  instance  of  a by  3 when  this  rule  is 
applied.  In  this  section  we  briefly  discuss  several  approaches 
to  defining  "parallel  grammars",  in  which  rules  are  applied 
in  more  than  one  place  at  a time. 

We  first  consider  an  approach  [2]  in  which  we  still 
apply  only  a single  rule  a^3  at  a given  time,  but  we  apply 
this  rule  by  replacing  every  instance  of  a by  3.  One  problem 
with  this  approach  is  that  instances  of  a can  overlap.  For 
example,  if  we  apply  the  rule  AA  -*■  BB  to  the  string  AAA,  in 
parallel,  the  result  is  (presumably)  BBBB,  since  AAA  contains 
two  instances  of  AA;  thus  application  of  the  isometric  rule 
AA  -►  BB  changes  the  length  of  the  string.  (Indeed,  if  we 
apply  AAA  ->■  BB  to  a’^  in  parallel,  we  get  B^  , so  that 

applying  a length-decreasing  rule  can  increase  the  string 
length.)  In  ordinary  ("sequential")  rule  application,  this 
could  not  happen;  applying  the  rule  AA  -*■  BB  to  AAA  yields 
either  BBA  or  ABB,  to  which  the  rule  no  longer  applies. 

Another  problem  with  parallel  rule  application  is  that 
parsing  and  generating  are  no  longer  inverses  of  one  another. 
For  excunple,  applying  AA  -►  BB  to  AAA  in  parallel  yields 
BBBB,  but  applying  BB  -►  AA  to  BBBB  in  parallel  yields  AAAAAA, 
since  BBBB  contains  three  instances  of  BB.  In  fact  (see  [2]), 
it  is  not  hard  to  exhibit  a grammar  G such  that  the  sets  of 


strings  generated  and  parsed  by  G "in  parallel"  are  disjoint 
from  one  another  and  from  L(G) . 

The  "parallel  language"  Lp(G)  generated  by  a given 
grammar  G is  not  the  same  as  G's  "sequential  language"  L(G) 
in  general,  but  it  is  the  same  in  certain  important  cases. 

For  example,  consider  the  finite-state  grammars;  it  is  evident 
ttat  these  have  the  property  that,  at  any  stage  of  a derivation, 
at  most  one  nonterminal  symbol  is  present.  (Grammars  with 
this  property  are  called  "linear".)  Since  the  rules  of  a 
finite-state  grammar  all  have  left-hand  sides  consisting  of 
a single  nonterminal  symbol,  it  is  clear  that  at  any  stage 
of  a derivation,  a given  rule  can  apply  in  at  most  one  place; 
thus  it  makes  no  difference  whether  a rule  is  applied 
"sequentially"  (i.e.,  in  one  place)  or  in  parallel.  In  Other 
words,  if  G is  a finite-state  (or  more  generally,  a linear) 
grammar,  we  have  Lp (G)  = L(G). 

It  can  also  be  shown  that  the  class  of  languages  gen- 
erated in  parallel  by  grammars  is  the  same  as  the  class  of 
languages  generated  in  the  usual  way;  and  similarly  for  the 
classes  of  languages  generated  sequentially  and  in  parallel 
by  monotonic  grammars.  To  prove  that  any  (sequential) 
language  is  a parallel  language,  we  show  that  for  any 
grammar  G,  there  exists  a grammar  G*  with  L(G*)  = L(G) , such 
that  at  any  step  of  a derivation  in  G* , no  rule  applies  at 
more  than  one  place.  Specifically,  for  each  rule 
A.  . . .A  -*■  B,  ...B  of  G,  G*  has  the  rule  A?A-...A„  -►  B?B_...B  , 
where  the  barred  symbols  are  all  nonterminals.  We  also  give 


G*  the  rule  S S*  and  the  set  of  rules 

A*B  AB*  and  -*■  A*B 

for  all  pairs  of  nonterminals  one  of  which  is  starred  and  the 
other  is  not.  These  rules  initially  create  a * and  allow  it 
to  shift  from  symbol  to  symbol.  Since  the  rules  that  corres- 
pond to  those  of  G all  involve  the  *,  it  is  clear  that  any 
rule  applies  at  only  one  place  (evidently,  more  than  one 
* never  exists) . Finally,  we  give  G*  the  rules 

a*b  -»■  ab*  ; a*#  ->■  a# 

for  all  a,E  corresponding  to  terminal  symbols  a,b  of  G (or, 
if  we  do  not  want  to  introduce  the  # symbol,  we  design  G*  so 
that  the  rightmost  symbol  of  any  string  derivable  in  it  is 
always  uniquely  marked) . These  last  rules  allow  the  * to 
shift  rightward  through  symbols  that  correspond  to  terminals, 
turning  them  into  terminals  as  it  goes,  until  it  reaches  the 
right  end  of  the  string  and  vanishes.  It  is  evident  that 
this  process  can  result  in  a terminal  string  iff.  G*  gen- 
erated a string  of  symbols  corresponding  to  terminals,  by 
imitating  a derivation  in  G which  leads  to  a string  of  ter- 
minals; thus  the  resulting  terminal  string  must  be  in  L(G) . 

(If  the  last  rules  are  used  too  soon,  or  are  not  started 
with  the  * at  the  left  end  of  the  string,  a string  consisting 
entirely  of  terminals  will  not  be  created.)  Since  in  G* , no 
rule  can  apply  in  more  than  one  place,  we  have  Lp(G*)  = L(G*); 
thus  L(G)  = L(G*)  = Lp(G*),  which  proves  that  any  language 


is  a parallel  language.  Note  also  that  if  G is  monotonic,  so 
is  G*. 


Conversely,  we  can  show  that  for  any  grammar  G there 
exists  a grammar  G'  that,  in  effect,  applies  the  rules  of  G 
in  parallel;  thus  Lp(G)  = L(G'),  so  that  any  parallel 
language  is  a sequential  language.  Basically,  we  define  G' 
to  simulate  an  automaton  A'  (compare  the  proof  of  Theorem 
1.1).  Suppose  that,  at  a given  stage  in  the  operation  of 
A' , we  are  ready  to  apply  a rule  of  G in  parallel  to  the 
current  string  a (initially,  this  string  is  S) . A'  picks  a 
rule  a-^S,  scans  a,  and  marks  every  position  in  o at  which  a 
match  to  a begins.  It  then  scans  o again  and  replaces  each 
instance  of  a by  3.  (If  instances  overlap,  the  part  of  a 
from  the  start  of  one  instance  of  a to  the  start  of  the  next 
is  replaced  by  3.)  When  this  process  is  complete,  we  are 
ready  to  apply  another  rule  of  G.  Readily,  if  G is  mono- 
tonic, so  is  G'.  (A  detailed  description  of  G'  can  be  found 
in  [2].) 

The  remarks  in  the  preceding  three  paragraphs  show 
that  any  (arbitrary,  context-sensitive,  finite-state)  language 
is  an  (arbitrary,  context-sensitive,  finite-state)  parallel 
language,  and  conversely.  The  analogous  result  about 
context-free  languages  is  false.  For  example,  consider  the 
context-free  grammar  whose  rules  are 

S SS ; S a 

The  parallel  language  of  this  grammar  is  readily  the  set  of 


strings  {a^  ln=0,l,2, . . . but  it  is  well-known  that  this  is 
not  a context-free  language  in  the  ordinary  sense  (see, 
e.g.,  [1,  p.  57,  Theorem  4.7]).  Conversely,  it  can  be  shown 

that  the  parenthesis-string  language,  which  is  context-free 
[1,  p.  67],  is  not  parallel  context-free.  On  the  relation- 
ship between  context-free  and  parallel  context-free  languages 
see  [3,  4]  . 

Parallel  rule  application  has  a particularly  convenient 
interpretation  for  rules  that  are  in  the  context-sensitive 
form  CAn  ^Tn:  For  each  instance  of  ^An  in  the  given  string 
o,  we  replace  the  A by  a x*.  In  this  case,  some  of  the  prob- 
lems mentioned  at  the  beginning  of  this  section  do  not  arise, 
since  the  substrings  being  replaced  (i.e.,  the  A's)  cannot 
overlap,  even  if  the  CAn's  do  overlap.  Parsing  and  gener- 
ation are  still  not  always  inverses  of  one  anohter;  e.g.,  if 
we  apply  AA  -»■  AB  to  AAA  we  obtain  ABB,  whereas  if  we  apply 
AB  -»■  AA  to  ABB  we  obtain  AAB.  On  the  other  hand,  string 
length  can  never  decrease,  since  A's  are  being  replaced  by 
nonnull  strings  (x's).  The  results  in  the  preceding  para- 
graphs all  continue  to  hold  for  this  modified  concept  of 
parallel  rule  application. 


*Note  that  this  is  not  the  same  as  replacing  each  instance  of 
^An  by  ^xri;  for  the  rule  AA  -►  AB,  applied  to  the  string  AAA, 
replacing  AA's  by  AB's  gives  ABAB,  whereas  replacing  A's  by 
B's  when  they  have  A's  on  their  left  gives  ABB. 


Another  approach  to  defining  parallelism  for  context- 


sensitive  grammars  is  to  apply  rules  in  all  possible  positions 
at  the  scime  time.  In  other  words,  given  a string  o = 
for  each  A.  we  choose  a rule  C-A.n-  C-T.n-  of  G that  applies 
to  A^  in  o (i.e.,  such  that  precedes  Aj^  in  o,  and 

follows  it),  and  replace  A^  by  (If  no  such  rule  exists, 

we  leave  A^  unchanged.)  This  is  done  in  parallel  for  every 
symbol  in  o;  the  rule  used  is  chosen  independently  for  each 
A^.  Parallel  rule-application  systems  of  this  kind  are 
called  L-systems  [5-7];  if  the  rules  are  all  context-free, 
they  are  called  OL-systems . L-systems  have  been  extensively 
studied  as  models  of  biological  growth;  they  will  not  be 
discussed  here  in  detail. 

In  defining  L-systems,  it  is  customary  to  make  no  dis- 
tinction between  terminal  and  nonterminal  vocabularies;  the 
language  is  the  set  of  all  strings  that  can  be  derived  from 
the  initial  string.  Another  possibility  is  to  define  the 
language  as  the  set  of  all  such  strings  that  are  stable  under 
application  of  the  rules;  such  strings  correspond,  from  the 
biological  growth  standpoint,  to  "adult"  organisms.  It  is 
not  hard  to  show  [8]  that  the  "adult  languages"  of  L-systems 
are  just  the  context-sensitive  languages.  In  fact,  given  an 
L-system  H and  a string  o,  we  can  easily  define  a tape- 
bounded  acceptor  A that  accepts  iff.  it  belongs  to  the  adult 
language  of  H.  [A  first  checks  that  a is  stable  under  H. 

It  then  nondeterministically  generates  a sequence  of  strings 

applying  the  rules  of  H to  the  initial  string  Oq  , 
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and  checks  at  each  step  whether  matches  a.  Since  we  have 
assumed  that  the  rules  of  H are  context-sensitive  (i.e.,  the 
T^'s  are  non-null),  we  know  that  [Oq]  | 1 s-  1 02 1 ^ ...  ; 

thus  if  0 is  derivable  from  Oq  in  H,  no  can  be  longer  than 
o,  so  A has  room  to  store  it,  as  in  the  proof  of  Theorem  1.3. 
Thus  if  o is  derivable  in  H,  A can  discover  this  fact  and 
accept  0.1  Conversely,  given  a context-sensitive  grammar  G, 
we  can  define  a modified  G*  such  that  at  any  stage  of  a de- 
rivation in  G*  there  is  only  one  place  where  any  rule  applies, 
as  shown  earlier  in  this  section.  We  can  thus  define  an  L- 
system  H*  that  simulates  G* . Note  that  in  the  definition  of 
G*,  as  long  as  the  * remains,  there  is  always  some  rule  that 
applies;  but  the  * disappears  only  when  all  the  symbols  have 
been  turned  into  terminals*.  Thus  the  only  strings  that  are 
stable  under  the  rules  of  H*  are  the  terminal  strings  of  G* , 
which  are  the  same  as  the  terminal  strings  of  G;  hence  the 
adult  language  of  H*  is  just  L(G).  If  we  modify  the  defini- 
tion of  an'  L-system  to  allow  erasing  rules  (i.e.,  CAn  Ch)  , 
it  can  be  shown  that  the  adult  languages  are  just  the  arbitrary 
(Turing-machine)  languages  (but  allowing  the  null  string  to 
be  in  a language);  the  proof  is  analogous.  [L-systems  that 
do  not  allow  erasing  rules  are  called  "propagating".] 


*This  requires  a slight  modification  of  the  definition  of  G* 
so  that  the  * can  only  begin  creating  terminals  when  it  is 
at  the  left  end  of  a string;  the  details  are  straightfor- 
ward. 


Similarly,  it  can  be  shown  that  the  adult  languages  of  OL- 
systems  are  just  the  context-free  languages.  For  the  details 
of  these  proofs,  see  [8]. 


In  analogy  with  Section  1.3,  one  can  consider  "isometric" 
parallel  grammars  (or  L-sys terns)  in  which  the  rules  are  all 
of  the  form  CAn  iBr\,  so  that  strings  can  grow  only  by  re- 
writing #s  at  their  ends.  L-systems  of  this  special  type 
are  essentially  nondeterministic  cellular  automata,  in  which 
the  transition  function  is  defined  by  the  rewriting  rules: 
state  A,  in  the  context  of  states  C on  the  left  and  n on  the 
right,  can  change  into  state  B.  If  #s  are  never  rewritten, 
they  become  bounded  cellular  automata. 
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Matrix  granunars 

In  this  section  we  discuss  grammars  that  generate  or 
parse  sets  of  rectangular  arrays.  Grammars  whose  languages 
are  sets  of  connected  (not  necessarily  rectangular)  arrays 
will  be  considered  in  Section  3. 

A class  of  "matrix  grammars"  [9-11]  that  generate 
rectangular  arrays  can  be  informally  defined  as  follows: 

a)  A string  grcimmar  G generates  a string  a which  will 
become  the  top  row  of  the  array. 

b)  The  symbols  in  a are  initial  symbols  of  a set  of 

finite-state  string  grammars  These 

grammars  operate  in  parallel  (compare  Section  1.4) 
to  generate  the  columns  of  the  array.  Their  oper- 
ation must  be  coordinated  so  that  in  every  column, 
at  any  given  time,  a rule  of  the  same  length  if 
applied,  and  that  the  terminating  rules  are  all 
applied  at  the  same  time.* 

Formally,  a matrix  grammar  M is  a pair  (G,G) , where  G is  a 
grammar  and  G = {Gj^,...,G^}  is  a set  of  finite-state  grammars, 
such  that  the  terminal  vocabulary  of  G is  the  set  {Sj^,...,S^} 


^ *We  can  assume  without  loss  of  generality  that  the  rules  of 

t each  G.  are  all  of  the  forms  A->-aB  and  A-^a,  where  A,B  are 

1 

nonterminals  and  a is  a terminal.  Under  this  assumption, 
it  suffices  to  require  that  the  terminating  rules  are  applied 
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in  every  column  at  the  same  time . 


( 
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of  initial  symbols  of  the  G^'s.  (We  assume  that  the  non- 
terminal vocabularies  of  the  G^'s  are  disjoint.)  M operates 
by  generating  a (horizontal)  string  o of  S^'s  using  the 
rules  of  G,  and  then  generating  a rectangular  array  from  the 
top  row  a by  applying  rules  of  the  G^'s  in  parallel,  and 
finally  terminating  simultaneously. 

Matrix  greunmars  are  of  interest  because  they  generate 
(or  parse)  rectangular  arrays,  but  unfortunately  the  classes 
of  array  languages  that  they  generate  are  not  the  same  as  the 
classes  accepted  by  the  various  types  of  array  acceptors. 
Specifically,  we  give  the  following  examples: 

a)  If  G is  finite-state,  the  language  L of  M is  a 

finite-state  array  language.  [Indeed,  we  can  define 
a finite- state  array  acceptor  A that  accepts  L as 
follows:  Given  a rectangular  array  R,  A scans  the 
last  column  C of  R,  simulates  acceptors  for  the 
finite-state  column  languages,  and  thus  determines 
to  which  of  those  languages,  if  any,  belongs. 

A can  thus  verify  whether  a' terminating  rule  of 
G could  have  produced  any  of  the  initial  symbols 
that  began  the  generation  of  A then  scans  the 

next-to-last  column  C , , determines  which  symbols 

m-i 

could  have  begun  its  generation,  and  verifies 
whether  a rule  of  G could  have  produced  any  of 
these  symbols  together  with  a nonterminal  that 
then  resulted  in  S. 


This  process  is  repeated 


until  all  of  R has  been  accounted  for.]  Conversely, 
however,  there  are  (deterministic,  tape-bounded) 
finite-state  rectangular  array  languages  that 
cannot  be  generated  by  any  such  M.  For  example, 
consider  the  set  L of  square  arrays  of  even  side 
length  whose  rows  are  all  of  the  form  a^b"'.  No 
such  M can  generate  L,  since  the  string  language 
{aV|  m=l , 2 , . . . } is  not  finite-state  (see  Section 
3.2  of  Chapter  3).  On  the  other  hand,  a finite-state 
array  acceptor  can  verify  that  its  input  array  R 
is  in  L as  follows:  Verify  squareness  (and  even 
side  length)  by  moving  "diagonally";  then  move  at 
"67j°"  (alternately  two  steps  upward  and  one  left- 
ward, starting  at  the  lower  right  corner)  to  find 
a middle  column;  finally,  move  down  that  column 
and  verify  that,  in  each  row,  there  are  a's  on  its 
left  and  b's  on  its  right.  Thus  the  class  of  matrix 
languages  for  which  G is  finite-state  is  a proper 
subset  of  the  class  of  finite-state  array  languages. 
[Readily,  we  can  require  A in  the  first  part  of  the 
proof  to  be  deterministic  and  tape-bounded;  thus 
these  matrix  languages  are  a proper  subset  of  the 
deterministic,  tape-bounded  finite-state  array 
languages. ] 


b)  If  G is  context-free,  the  language  of  M is  not 

finite-state.  For  example,  the  set  L of  rectangular 


arrays  of  even  width  whose  rows  are  all  of  the 
form  a™b**^  C2U1  be  generated  by  such  an  M (G  gener- 
ates S^s";  the  rules  of  and  G2  are  Sj^-^aSj^,S^-^a, 
and  those  of  G2  and  S2‘^bS2»S2->-b)  , but  L cannot  be 
accepted  by  a finite-state  array  acceptor,  since 
{aV|  i=l,2,...}  is  not  a finite-state  string 
language  (consider  the  arrays  of  height  11).  Thus 
the  matrix  languages  in  general  (even  for  context- 
free  G's)  are  not  a subset  of  the  finite-state 
array  languages.  Conversely,  there  are  (deterministic, 
tape-bounded)  finite-state  array  languages  that  are 
not  matrix  languages,  for  any  choice  of  G.  For 
example,  the  set  L consisting  of  all  square  arrays 
is  not  a matrix  language,  since  the  termination 
decision  in  generating  the  columns  does  not  depend 
on  the  array  width.  [The  step  numbers  at  which 
column  termination  can  occur  depend  on  the  set  of 
S^'s  that  initiated  the  columns;  there  are  only 
finitely  many  such  sets,  and  they  cannot  carry  enough 
information  to  provide  for  a different  termination 
step  for  every  top  row  width.]  Thus  the  matrix 
languages  and  the  finite-state  array  languages 
are  incomparable. 

c)  The  matrix  languages  for  which  G is  context-sensitive 
are  a proper  subset  of  the  tape-bounded  array 
languages.  For  example,  the  arrays  whose  columns 


are  all  of  the  form  a"'b”'  are  a tape-bounded  array 
language,  but  are  not  a matrix  language  (since 
{a"'b"'|m=l,2, . . . } is  not  a finite-state  string 
language).  Conversely,  a tape-bounded  acceptor 
can  scan  the  columns  of  a rectangular  array,  deter- 
mine which  S^'s  could  have  initiated  their  generation, 
record  these  (sets  of)  S^'s  in  the  top  row,  and  then 
simulate  a one-dimensional  tape-bounded  acceptor  to 
verify  whether  some  such  set  of  S^'s  could  have 
been  generated  by  G;  thus  any  such  matrix  language 
is  a tape-bounded  array  language.  On  the  other  hand, 
there  are  matrix  languages  (having  non-context- 
sensitive  top  rows,  and  height  1)  which  are  not 
tape-bounded  array  languages;  thus  the  tape-bounded 
array  languages  and  the  matrix  languages  are  in- 
comparable. Finally,  the  matrix  languages  are  a 
proper  subset  of  the  Turing  rectangular  array 
languages,  by  arguments  similar  to  those  already 
given. 

It  can  be  shown  [9,12]  that  the  languages  of  matrix  grammars 
for  which  G is  context-sensitive  are  the  same  as  the  languages 
of  a special  class  of  parallel-sequential  array  acceptors 
(Section  of  Chapter  7)  — namely,  the  class  in  which  the 
cells  (of  the  one-dimensional  cellular  acceptor)  do  not 
communicate  with  their  neighbors  until  the  acceptor  has 
reached  the  last  row  of  its  input  array. 


A number  of  other  grammar-like  mechanisms  can  be  used 
to  generate  rectangular  array  languages.  In  [10-11] , for 
example,  a grammar  generates  a string  which  specifies  a 
sequence  of  horizontal  and  vertical  concatenations  to  be 
performed  on  rectangular  arrays.  It  is  understood  that  when 
two  arrays  are  horizontally  (vertically)  concatenated,  they 
must  have  the  same  numbers  of  rows  (columns) ; hence  any  such 
sequence  of  concatenation  operations  generates  a rectangular 
array.  Another  way  to  insure  rectangularity  is  to  require 
that  all  border  symbols  of  a given  type  (north,  south,  east, 
or  west)  be  rewritten  simultaneously;  note  that  the  column 
generation  process  in  a matrix  grammar  is  a special  case  of 
this  (rewriting  all  south  border  symbols  at  the  same  time) . 
Such  models  have  been  studied  in  [13] . We  will  not  consider 
these  approaches  further  here. 


3.  Array  granunars 


This  section  introduces  grammars  that  generate  or  parse 
sets  of  connected  arrays,  and  investigates  their  relationship 
to  array  acceptors.  As  we  shall  see,  several  problems  arise 
with  array  grammars  that  did  not  arise  for  string  grammars. 

An  array  grammar  must  operate  by  replacing  subarrays  by 
subarrays,  just  as  a string  grammar  replaced  substrings  by 
substrings.  However,  if  the  two  subarrays  (a  and  3#  say) 
are  not  identical  in  size  and  shape,  it  is  not  clear  how  to 
replace  a by  3.  One  can  presumably  shift  the  rows  or  columns 
of  the  host  array  relative  to  one  another  so  as  to  make  room 
for  3;  but  this  may  cause  changes  in  symbol  adjacencies 
arbitarily  far  away  from  3,  since  adjacent  rows  or  columns 
may  shift  by  different  amounts.  Thus  applying  a local  re- 
writing rule  cx-»-3  may  cause  nonlocal  changes  in  the  host  array, 
which  seems  undesirable.  To  avoid  this  problem,  we  shall 
require  array  grammars  to  be  isometric  (see  Section  1.3); 
this  means  that  for  any  rule  a-»-3,  a and  3 are  geometrically 
identical,  and  the  array  grows  (or  shrinks)  by  rewriting 
(or  creating)  #s.  For  a treatment  of  non-isometric  array 
grammars,  see  [14] . 

A second  problem  with  array  grammars  is  how  to  insure 
that  they  preserve  connectedness  (and  nonemptiness)  of  the 
set  of  non-#s.  Before  formulating  conditions  for  this,  we 
first  observe  that  in  any  rule  a->-3,  a must  contain  non-#s, 
but  they  need  not  be  connected.  [In  one  dimension,  as  long 


as  the  non-#s  remain  connected,  a rule  in  which  a has  non- 


connected  non-#s  could  never  apply;  but  in  two  dimensions, 
a globally  connected  array  can  contain  locally  non-connected 
parts.]  On  the  other  hand,  if  a has  more  than  one  connected 
component  of  non-#s,  everv  such  component  must  touch  the 
border  of  a.  Our  conditions  on  3 are  then  as  follows: 

1)  If  the  non-#s  of  a do  not  touch  the  border  of  a, 
then  the  non-#s  of  3 must  be  connected  (and  non- 
empty) . 

2)  Otherwise, 

a)  Every  connected  component  of  non-#s  in  3 must 
contain  the  border  of  some  component  of  non- 
#s  in  a,  and 

b)  The  border  of  every  component  of  non-#s  in  a 
must  be  contained  in  some  component  of  non- 
#s  in  3. 

Proposition  3.1.  If  conditions  (1-2)  hold,  applying  the 
rule  a-^3  does  not  disconnect  or  eliminate  the  non-#s. 

Proof:  We  assume  that  non-#s  existed  and  were  connected 
before  a-»-3  was  applied.  In  case  (1)  , the  non-#s  of  a must  be 
the  only  non-#s  that  exist  (there  cannot  be  any  outside  a, 
since  they  would  have  to  be  connected  to  those  in  a,  which 
would  require  that  non-#s  exist  on  the  border  of  a) ; hence 
when  we  replace  a by  3#  the  non-#s  of  3 are  the  only  ones 
that  exist,  and  they  are  connected  by  (1) . 


In  case  (2),  we  first  show  that  any  two  non-#s  p,q  not 
in  a remain  connected  when  a is  replaced  by  3-  If  there  is 
a path  of  non-#s  from  p to  q that  does  not  meet  a,  this  is 

clear.  Otherwise,  note  that  each  time  the  path  enters  and 

leaves  a,  it  meets  only  one  component  of  non-#s  in  a,  and  by 
(2b)  the  border  of  this  component  is  contained  in  a component 
of  non-#s  in  3;  hence  each  such  segment  of  the  path  can  be 
replaced  by  a segment  in  3. 

Similarly,  if  p is  not  in  a and  q is  in  3,  then  by  {2a) 
the  component  of  non-#s  in  3 that  contains  q also  contains 

the  border  of  some  component  of  non-#s  in  a.  Now  p was 

connected  (outside  a)  to  this  component,  hence  to  its  border; 
thus  p is  connected  to  q. 

Finally,  if  p and  q are  both  in  3,  and  are  not  connected, 
they  are  both  in  components  of  non-#s  that  (by  (2a) ) contain 
borders  of  components  of  non-#s  in  a.  But  these  components 
were  connected  outside  a,  hence  so  were  their  borders.// 

It  is  clear  that  if  (1)  did  not  hold,  applying  a->-3  would 
disconnect  (or  annihilate)  the  non-#s.  If  (2a)  did  not  hold, 
a component  of  non-#s  in  3 might  be  created  that  failed  to 
be  connected  to  the  other  non-#s;  while  if  (2b)  did  not  hold, 
some  non-#s  outside  3 might  be  disconnected  from  the  other 


non-#s. 
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3.1.  Array  grammars  and  languages 

Formally,  an  (isometric)  array  grammar  is  a 5-tuple 
G = (V,V^,P,S,#) , where  all  of  these  are  defined  just  as  in 
Section  1.2,  except  that  P is  a set  of  pairs  of  connected 
arrays  (a, 3),  for  all  of  which 

a)  a and  3 are  geometrically  identical 

b)  a does  not  consist  entirely  of  #s 

c)  3 satisfies  conditions  (1-2)  of  Proposition  3.1. 

The  language  of  G,  L(G),  is  the  set  of  all  (non-null)  connected 
arrays  Z on  such  that  E (embedded  in  an  infinite  array  of 
#s)  can  be  derived  in  G from  the  initial  array,  which  consists 
of  a single  S (embedded  in  an  infinite  array  of  #s) . [De- 
rivations are  defined  exactly  as  in  Section  1,  except  that 
they  involve  replacement  of  one  subarray  by  another,  rather 
than  of  one  substring  by  another.  Parsing  is  also  defined 
just  as  in  Section  1.]  Note  that  by  Proposition  3.1  and 
induction,  the  array  resulting  from  any  derivation  always 

has  its  non-#s  connected. 

As  in  Section  1.1,  we  can  (and  shall  from  now  on) 
assume  that  terminal  symbols  are  never  rewritten  by  any  H 

rule  of  G.  I 

An  array  grammar  is  called  monotonic  if  #s  are  never  I 

created  by  any  rule  — in  other  words,  for  all  rules  a-^3  of  G,  I 

there  are  #s  in  3 only  in  positions  corresponding  to  #s  in  a.  I 

[We  can  also  define  an  array  grammar  G to  be  "context-free"  I 

if,  for  all  rules  a->3  of  G,  a consists  of  a single  nonterminal  I 


r 


symbol  and  (possibly)  of  #s;  note  that  such  rules  do  use 
#s  as  "context."  Similarly,  we  can  call  G linear  if  G is 
"context-free"  and,  in  addition,  any  3 contains  at  most  one 
nonterminal  symbol;  note  that  at  any  stage  (except  the  last) 
of  a derivation  in  such  a G,  exactly  one  nonterminal  exists. 
As  we  shall  see  later,  there  does  not  seem  to  be  a good 
analog  of  "finite-state"  for  array  grammars.] 

In  some  of  the  excimples  to  be  given  later,  it  will 
be  convenient  to  introduce  some  notation  that  allows  us  to 
compactly  describe  sets  of  array  rewriting  rules  that  differ 
by  90°  rotations.  We  shall  denote  by  a-*-3  (ROT)  the  set  of 
four  rules  in  which  a and  3 are  both  rotated  by  0°,  90°, 
180°,  and  270°.  For  example. 


AB  UV  (ROT) 


denotes  the  four  rules 


AB  UV 


B ^ V 
A U 


BA  VU 


Alternatively,  we  may  denote  by  A(d)B  the  pair  of  adjacent 

symbols  such  that  B is  in  direction  d (=U,D,L,  or  R)  from  A; 

thus  A(R)B  = AB,  A(L)B  E BA,  A(U)B  E ® and  A(D)B  E 

A o 


In  this  notation,  we  may  write 


A(d)B  ->■  U(d)V 


instead  of  AB  UV  (ROT)  . 


for  all  d € A E {U,D,L,R} 


3.2. 


Our  goal  in  this  section  is  to  prove  that  (arbitrary, 
monotonic)  array  grammars  generate  the  same  classes  of 
languares  as  (Turing,  tape-bounded)  array  acceptors.  The 
proofs  are  based  on  [15];  see  also  [16],  which  proves  an 
analog  of  Theorem  3.3  using  a somewhat  different  definition 
of  an  array  grammer.  We  also  discuss  the  relationship  be- 
tween finite-state  array  grammars  and  array  acceptors;  this 
discussion  is  based  on  [17]. 

Theorem  3.2.  The  languages  generated  by  array  grammars  are 
the  same  as  the  languages  accepted  by  Turing  array  acceptors. 


Proof:  Given  an  array  grammar  G,  we  define  a TAA,  A,  that 


accepts  exactly  L(G)  as  foD.ows:  Given  an  array  i:  of  non-#s 
in  the  terminal  vocabulary  of  G,  embedded  in  an  infinite 
array  of  #s,  A moves  around  nondeterministically , starting 
at  some  point  of  Z,  and  rewrites  each  symbol  x (possibly  #) 


that  it  comes  to  as  (x,#).*  Finally,  at  some  step,  A rewrites 
some  X as  (x,S) ; this  can  only  happen  once.  After  it  happens, 

A begins  to  simulate  rules  of  G on  the  second  terms  of  pairs; 
pairs  with  no  second  term  are  regarded  as  having  second  term  #. 


*This  is  done  in  order  to  insure  that  A is  always  on  a con- 
nected set  of  non-#s;  if  A moved  onto  the  #s  without  rewriting 
them  as  pairs,  it  might  be  unable  to  find  Z again. 


Suppose  that  at  some  step  A decides  to  apply  the  rule  a-*-3 
of  G.  It  then  searches  (nondeterministically ) for  one  of  the 
non-#  symbols  in  a (as  a second  term) , marks  it,  checks 
(deterministically)  for  the  other  symbols  as  second  terms 
(these  are  in  known  positions  relative  to  the  given  symbol) , 
marks  them,  and  when  they  have  all  been  found,  rewrites 
these  second  terms  as  the  corresponding  symbols  in  3;  after 
this  is  done,  A is  ready  to  simulate  another  rule.  (While 
searching,  A continues  to  rewrite  x's  as  (x,#)'s.)  At  any 
stage  after  applying  a rule  of  G,  A can  systematically  scan 
the  array  of  non-#s  (Proposition  4.1  of  Chapter  4)  and  check 
whether  (a)  every  non-#  is  a pair;  (b)  the  second  term  of 
every  pair  is  the  same  as  its  first  term.  [A  can  also  check, 
during  some  such  scan,  that  the  non-#  first  terms  are  in  fact 
all  in  V^.]  If  this  is  found  to  be  true,  A accepts  Z;  other- 
wise, A can  resume  the  simulation  of  G.  Evidently  A accepts 
Z iff.  a derivation  in  G exists  that  generates  a copy  of  Z; 
thus  A accepts  exactly  L(G)  (from  some  starting  point). 
Conversely,  given  A,  we  define  a grammar  G that 
? generates  exactly  L(A)  as  follows:  Starting  with  an  S on 

' a background  of  #s,  G begins  by  generating  an  arbitrary 

i array  Z of  triples  of  the  form  (x,x,0)  or  (x,x,l) , where 

^ X is  any  non-#  symbol  in  the  vocabulary  V of  A,  and  where 

there  is  always  exactly  one  1.  This  can  be  done  using 
' the  rules 


la)  S -►  (x,x,l) 

lb)  (x,x,l)#  - (x,x,0) (y,y,l)  (ROT) 

lc)  (x,x,l)  (y,y,0)  -►  (x,x,0)  (y,y,l)  (ROT) 

ld)  (x,x,l)  -►  (x,x,(qQ,N)) 
for  all  X,  y # in  V. 

When  (Id)  is  used,  the  1 turns  into  a pair  (qQ,N)  repre- 
senting the  initial  state  and  (fictitious)  "previous  move 
direction"  of  A. 

Next,  G simulates  the  operation  of  A on  the  array  of 
second  terms  of  the  triples;  the  first  terms  remain  un- 
affected. This  is  done  using  the  rules  (for  all  x,u,v  in  V) . 

2a)  (x,y,(q,d))  (x,z,(q',N))  for  all  (q' ,z,N)  €6  (q,y  ,d) 

2b)  (x,y,  (q,d)  ) (d' ) (u,v,0)  (x,z,0)  (d' ) (u,v,  (q*  ,d' ) ) 

for  all  (q* ,z ,d’ ) ^6 (q^y fd) 

2c)  (x,y,  (q,d))  (d’)#  (x,z,0)  (d')  (#,#,  (q*  ,d'))  (similarly) 

where  6 is  the  transition  function  of  A,  and  provided  that  q 
is  not  an  accepting  state  of  A. 

Finally,  if  the  simulation  of  A enters  an  accepting 
state,  the  triples  are  turned  into  their  first  terms  using 
the  rules 

3a)  (x,y,(q,d))  x for  all  x,y,tV  and  all  qtQA 

3b)  (u,v,0)x  -►  ux(ROT)  for  all  u,v,x6V. 

Since  V-{#}  is  the  terminal  vocabulary  of  G,  this  means 
that  G generates  a terminal  array  of  non-#s  (the  first  terms 
of  E)  iff.  A accepts  this  array  (from  some  starting  point) .// 


Theorem  3.3.  The  languages  generated  by  monotonic  array 
grammars  are  the  same  as  the  languages  accepted  by  tape- 
bounded  array  acceptors. 

Proof ; In  the  first  part  of  the  proof  of  Theorem  3.2,  note 
that  at  any  step  of  a derivation  of  I in  the  monotonic  array 
grammar  G,  the  non-#s  are  always  a subset  of  Z,  since  #s 
can  never  be  created  by  G.  Thus,  we  can  simulate  G using 
a tape-bounded  A that  always  remains  on  E.  [A  problem 
arises  with  this  simulation  if  a rule  a->-3  of  G uses  #s  as 
context  (i.e.,  there  are  #s  in  a which  are  also  in  the 
corresponding  positions  in  3);  these  #s  may  be  outside  E, 
but  A must  verify  their  presence  in  order  to  apply  the  rule. 
This  can  be  done  using  the  array  scanning  process  described 
just  prior  to  Proposition  4.6  of  Chapter  4.  Suppose  that 
A is  located  at  position  (i,j)  and  wants  to  verify  that  there 
is  a # in  position  (i',j')f  where  the  differences  i-i'  and 
j-j'  are  known  to  A.  To  do  this,  A marks  (i,j),  finds  the 
outer  border  of  E,  and  scans  E row  by  row.  When  A reaches 
the  row  with  the  marked  point,  it  returns  to  the  outer  border 
and  follows  it,  using  the  positions  of  markers  to  keep  track 
of  its  net  up  and  down  moves.  If  the  outer  border  never 
reaches  row  i',  E cannot  intersect  that  row,  so  that  posi- 
tion (i',j')  is  certainly  #.  Otherwise,  A marks  the  points 
of  the  outer  border  that  are  on  row  i ' , and  scans  these  rows 
of  E,  marking  their  points.  Analogously,  using  a column  by 


column  scan,  A finds  the  marked  point  and  checks  whether 
the  outer  border  reaches  column  j'.  If  not,  (i',j')  is  #; 
if  so,  A marks  the  points  of  I that  are  on  column  j'.  If 
these  marks  ever  encounter  the  marks  on  row  i',  (i',j')  is 
not  #;  otherwise,  it  is  #,  and  A can  rescan  L,  erase  the 
marks  on  row  i*  and  column  j',  rescan  Z and  return  to  the 
marked  point  (i,j).  In  this  way,  A can  verify  that  #s 
exist  in  given  positions  relative  to  some  non-#  point  of  a, 
and  thus  check  that  all  of  a is  present,  without  having  to 
leave  Z.  Note  that  a similar  process  may  be  necessary  for 
the  rewriting  of  a,  since  the  non-#s  of  a may  be  separated 
by  #s,  and  A may  have  to  compute  the  positions  of  these 
non-#s  in  order  to  locate  them  and  rewrite  them.]  After 
any  step  of  the  simulation,  A can  scan  E and  check  that  the 
first  and  second  terms  are  all  the  same  (and  all  in  V^) . 

If  so,  A accepts;  otherwise,  it  continues  the  simulation. 
Thus  A accepts  exactly  I,(G)  , as  in  the  proof  of  Theorem  3.2. 

In  the  second  part  of  the  proof,  note  that  the  only 
rules  of  G that  can  create  #s  are  the  terminating  rules 
3(a-b);  and  these  create  #s  only  if  triples  with  # first 
terms  were  created  by  the  simulation  rule  (2c) . But  if  A 
is  tape-bounded,  we  can  modify  (2c)  to  have  the  form 

(x,y,  (q,d))  (d')#  (x,z,  (q’',d'"^))  (d*)# 

where  q"  is  a possible  state  of  A after  it  has  bounced  back 
off  the  #.  Thus  when  A is  tape-bounded,  G need  never  create 
#s,  so  that  G can  be  mono tonic.// 


It  does  not  seem  to  be  easy  to  define  a class  of 


array  grammars  whose  languages  are  the  same  as  those  of  the 
finite-state  array  acceptors.  (A  generator  model  that 
generates  exactly  the  FSA  languages  is  described  in  [18] . 
However,  in  this  model,  every  time  a given  symbol  is  re- 
written, it  must  be  rewritten  in  the  same  way,  even  though 
the  generation  process  cannot  tell  whether  or  not  this  is 
happening;  thus  this  model  requires  some  means,  outside  the 
generator  itself,  to  reject  arrays  in  which  a rewriting 
inconsistency  occurs.)  Of  course,  one  can  always  define  a 
class  of  array  grammars  that  are  capable  only  of  simulating 
FSA's  [19];  but  this  is  artificial. 

In  one  dimension,  the  linear  grammars  (in  which,  at 
any  step  of  a derivation  except  the  last  step,  exactly  one 
nonterminal  symbol  exists)  generate  more  than  the  finite- 
state  languages  (e.g.,  {a”’b"*|m=l,2, . . . } is  a linear  string 
language,  having  the  grammar  whose  rules  are  S ->■  aSb,S -»■  ab)  ; 
whereas  the  "right  linear"  grammars,  in  which  (until  the.  last 
step)  the  sole  nonterminal  symbol  is  always  at  the  right  end 
of  the  string,  generate  exactly  the  finite-state  languages 
(Theorem  1.4).  In  two  dimensions,  there  is  no  natural  analog 
of  "right  linear."  Moreover,  we  shall  now  show  that  the 
languages  of  linear  array  grammars  are  incomparable  with  the 
FSA  languages. 

We  first  exhibit  an  FSA  language  that  cannot  be  gen- 
erated by  a linear  array  grammar.  Consider  the  set  of  thin. 


upright  T-shaped  arrays  of  x's  on  a background  of  #s.  This 
set  is  accepted  by  a deterministic,  tape-bounded  FSA  which 
operates  as  follows:  It  moves  up  until  it  hits  a #,  then 
moves  left  until  it  hits  a # again.  It  then  verifies  that 
it  is  on  a row  of  x's  that  have  #'s  above  and  below  them, 
with  exactly  one  exception  that  has  an  x below  it  and  that 
is  not  at  either  end  of  the  row.  Finally,  it  moves  back  to 
the  exceptional  x and  moves  downward,  verifying  that  it  is 
on  a column  of  x's  that  have  #s  on  their  left  and  right. 

When  it  reaches  the  bottom  of  this  column,  if  all  these 
verifications  have  been  carried  out  successfully,  it  accepts. 

We  now  show  that  the  set  of  T's  cannot  be  generated 
by  a linear  array  grammar.  Suppose  G were  such  a grammar; 
let  the  greatest  diameter  of  any  right  hand  side  of  a rule 
of  G be  k.  Since  the  T's  can  be  arbitrarily  large,  it  is 
clear  that  G must  generate  the  ends  of  the  arms  of  a large 
T at  different  steps  in  the  derivation  of  that  T.  Let  these 
arm  ends  be  a,  b,  and  c.  One  of  them,  say  a,  can  be  generated 
before  the  point  P at  the  T-junction  is  generated,  but  b 
and  c must  be  generated  afterwards.  After  P is  generated, 
if  the  nonterminal  moves  sufficiently  far  (>k)  down  the  b 
arm,  it  can  never  generate  the  c arm,  since  it  cannot  return 
down  the  b arm  (which  now  consists  of  terminals)  or  cross 
the  #s  (which,  once  rewritten,  would  destroy  the  shape  of 
the  desired  thin  T) . 


Conversely,  we  can  exhibit  a language  that  is  generated 


i 

f 


by  a linear  array  grammar  but  is  not  accepted  by  a tape- 
bounded  FSA.  Let  G be  the  array  grammar  whose  rules  are 

S#  ->  xS  ; S#  -*■  xT 

T X T X 

# T ' # U 

#U  -*■  Ux  ; #U  Vx 


Informally,  the  S moves  to  the  right,  leaving  a trail  of  x's, 
until  it  changes  to  a T;  the  T moves  down,  trailing  x's, 
until  it  changes  to  a U;  the  U moves  left,  leaving  x's  behind 
it,  until  it  changes  to  a V;  and  the  V moves  up,  trailing 
x's,  until  it  changes  to  an  x.  Thus  the  language  of  this 
grammar  consists  of  four-sided  upright  rectangular  arcs, 
composed  of  x's,  which  may  touch  themselves , but  cannot  cross 
themselves.  In  particular,  all  the  hollow,  thin  upright 
rectangles  of  x's  are  in  this  language.  But  as  we  have 
seen  (in  the  proof  of  Theorem  4.3  of  Chapter  4),  any  tape- 
bounded  FSA  that  accepts  all  such  rectangles  must  also  accept 
various  sufficiently  large  rectangular  spirals  (having  many 
more  than  four  sides) . Hence  the  language  of  G is  not  a 
tape  bounded  FSA  language. 

Another  possibility,  discussed  in  [17,19],  is  to 
allow  a linear  gramraar  to  rewrite  terminal  symbols,  but  not 
to  sense  what  symbols  are  present;  for  example,  in  a rule 


a -►  3»  a would  consist  of  a single  nonterminal  A together 


with  a set  of  "don’t-care"  symbols,  and  in  applying  the  rule 
we  would  rewrite  whatever  symbols  lie  in  those  positions 
relative  to  A.  [If  we  do  allow  the  grammar  to  sense  what 
symbols  are  present,  it  is  at  least  as  strong  as  an  ordinary 
linear  array  gr2unmar,  hence  Ccin  generate  a class  of  patterns 
that  is  not  an  FSA  language,  as  in  the  preceding  paragraph.] 

If  we  do  this,  it  becomes  possible  to  generate  thin  T-shaped 
patterns  (possibly  including  degenerate  T's  with  arms  missing) ; 
we  omit  the  details  here.  On  the  other  hand,  such  a "blind" 
grcimmar  could  not  generate  the  set  of  arcs  (composed  of  x's) 
that  do  not  cross  or  touch  themselves,  since  the  nonterminal 
leaving  the  trail  of  x's  could  not  know  when  it  was  about  to 
cross  its  own  path;  but  this  set  is  evidently  an  FSA  language 
(the  FSA  verifies  that  all  but  two  of  the  non-#s  have  exactly 
two  non-#  neighbors) . Conversely,  a "blind"  grammar  can 
generate  the  set  of  all  connected  arrays  of  x's;  but  this 
is  not  an  FSA  language.  [Proof:  It  contains  the  set  of  all 
thin,  hollow  rectangles  of  x's;  but  if  A accepts  such  a 
rectangle,  it  also  accepts  a sufficiently  large  rectangular 
spiral  without  visiting  its  ends,  so  that  it  cannot  tell 
whether  or  not  there  are  symbols  other  than  x at  the  ends.] 
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3 . 3 Parallel  array  grammars 

In  Section  1.4,  we  introduced  the  idea  of  parallel 
rule  application  (rewrite  all  instances  of  a as  3's,  rather 
than  just  a single  instance) , and  showed  that  the  classes  of 
languages  generated  in  parallel  by  (arbitrary,  context- 

sensitive)  granunars  are  the  same  as  the  classes  of  languages  * 

generated  by  those  types  of  grammars  in  the  ordinary  way. 

r' 

The  proofs  apply  also  to  isometric  grammars;  in  fact,  in 
the  proof  that  any  sequential  language  is  a parallel  language, 
if  G is  isometric,  so  is  G*,  while  in  the  proof  that  any 
parallel  language  is  a sequential  language,  we  Icnow  that  an 
isometric  G*  can  simulate  an  automaton  of  the  desired  type 
that  applies  the  rules  of  G. 

Analogous  results  can  be  established  for  (isometric) 
array  grammars;  the  details  are  straightforward  [20]  . One 
can  also  define  (isometric)  array  L-systems  (the  details 
will  be  omitted  here);  as  pointed  out  in  Section  1.4,  they 
are  essentially  nondeterministic  cellular  automata. 
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